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POSITION INFORMATION INPUT APPARATUS AND METHOD 

The present invention relates to a method and 
apparatus for inputting position information such as 
coordinate data particularly for use with a large screen 
display system. In detail, the present invention relates 
to a position information input apparatus and method for 
generating position information such as a coordinate 
expressing a position designated on a display screen by 
an operator. The operator may use a designation device 
for designating the position. The input position 
information can be used for controlling an externally 
connected computer, or for writing characters and 
graphics . 

Some of the prior coordinate input devices sense a 
light spot on the screen by using a CCD area sensor or 
linear sensor- The devices calculate and output 
coordinate values by performing an image processing using 
centroid coordinates, pattern matching etc.. Some of the 
prior coordinate input devices use position detection 
elements (an analogue device for obtaining an output 
voltage corresponding to a position of spot) called PSD 
(Position Sensitive Detector). 

For example, Japanese Patent Publication No. 7- 
76902 discloses an apparatus which senses a light spot of 




a parallel beam of visible light using a video camera, 
and calculates coordinate values, and the apparatus 
simultaneously sends and receives a control signal by 
infrared diffusion light. Japanese Laid-Open Patent 
Application No- 6-274266 discloses an apparatus which 
detects a coordinate value by a linear CCD sensor and a 
special optical mask. On the other hand, Japanese Patent 
No. 2503182 discloses a structure of an apparatus using 
PSD and a correction method for outputting a coordinate 
value from the apparatus. 

Nowadays, the brightness of large screen displays 
has improved and they can be used satisfactorily even in 
a brightly illuminated environment, and the display is 
expected to be in great demand. A coordinate input 
apparatus must be more tolerant to ambient light for use 
in such an environment together with the large screen 
display. The use of devices using an infrared light as 
a wireless communication unit is increasing recently. 
Since levels of infrared light and visible light are 
increasing in ambient light, it is an important feature 
for the apparatus to have a high tolerance to ambient 
light - 

However, as is disclosed in Japanese Patent 
Publication No. 7-76902 and Japanese Laid-Open Patent 
Application No. 6-2 742 66, ambient light is only controlled 
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by an optical filter in the apparatus using a prior-art 
CCD sensor. To the contraryi as is disclosed , n patent 

No. 2503182. an effect of the anient light is 
controlled by synchronized detection of frequency- 
Modulated light intensity in the apparatus using PSD . 
The apparatus with an optical filter achieves higher 
tolerance to ambient light. 

The brightness and resolution of large screen 
displays are increasing. The resolving power in a 
coordinate input apparatus must also be increased, but 
this is difficult to achieve in an apparatus using P SD 
having high tolerance to ambient light. This is because 
a dynamic range of sensor output voltage corresponds to 
a range of input area exactly, then the apparatus must 
have at least 60db or higher S/N ratio to achieve a 
resolving power or detection accuracy of 1mm. As is 
disclosed in Japanese Patent No. 2503182, since a 
digital correction of linear error is necessary, a high 
precision analogue circuit, a multi bit AD converter and 
an arithmetic circuit are required. si nce the s/N ratio 
of the sensor output signal depends on luminous energy 
and sharpness of the light spot, not only control of the 
ambient light but also a bright high precision optical 
system are required for producing a light spot. 
Accordingly, the apparatus increases in cost and size. 



However Patent Publication No. 7-76902 discloses a 
method using a plurality of video cameras simultaneously 
as a method for increasing a resolving power by using a 
CCD sensor. Such a method makes an apparatus increased 
in cost and size, and if a video camera having many 
pixels is used in the apparatus, it increases the 
apparatus' cost and size more than using a plurality of 
video cameras, and an artificially high resolving power 
realized in real time operation by performing an image 
processing also increases the apparatus 1 cost and size 
because high speed image processing is required. 

Japanese Laid-Open Patent Application No. 6-274266 
discloses a high resolving power realized by using a 
special optical mask and signal processing. The 
resolving power can be increased if the ambient light is 
weak and high S/N ratio is ensured. In practice, a 
linear sensor images a line, the ambient light has more 
effect on a line image in this situation because the line 
image can't be separated from ambient light within a 
plane, in contrast to a situation in which an area sensor 
images dots. For this reason, the apparatus is able to 
be used only in a special environment having a low level 
of ambient light. 

Generally the optical elements like CCD etc. are 
mass produced by semi-conductor processes, but the 



various features such as optic-electric conversion 
efficiency etc. differ widely depending on the product 
environment, the product condition and product lot etc. . 
For example a difference of about plus and minus 3 0 % in 
the optic-electric conversion efficiency is possible as 
a parts tolerance. When a CCD is worked at an electric 
source voltage of 5V, then if the nominal value of CCD 
output voltage in a dark condition is about 1.5V, the 
actual value for a particular device may be from about 
1.0 to 2.0 V (about plus and minus 30%) due to the 
acceptable parts tolerance. Therefore the threshold 
value must be set at 2 . 0V or more when determination of 
a light output is obtained by comparing the output with 
a fixed threshold voltage, but elements at the limits of 
the tolerance range will be unable to detect 
satisfactorily and the yield is thus decreased, in a 
structure which receives only low levels of light (namely 
CCD output is small). To adjust individually the 
threshold value set in each CCD described above can raise 
the light sensitivity, but assembly steps are increased 
and the cost goes up since an adjustment assembly is 
required. 

The present invention aims to solve the above 
problem of the prior art, and one aspect of this 
invention is to control the effect of the ambient light 



and to provide a coordinate input apparatus and method 
having a high resolving power and a high precision. 

Another aspect of this invention is to provide a 
small size and low cost coordinate input apparatus and 
method. 

Embodiments of the invention will now be described 
in detail with reference to the accompanying drawings , in 
which: 

Figure 1 is a schematic block diagram showing an 
arrangement of an optical coordinate input apparatus 
according to the embodiment; 

Figure 2 is a block diagram showing an arrangement 
of a designation device; 

Figure 3 is a truth table showing a relationship 
between the switch inputs and control outputs of the 
device of Figure 2; 

Figure 4 is a block diagram showing a schematic 
arrangement of the coordinate detection device of Figure 

i; 

Figure 5 is a schematic diagram showing a physical 
arrangement of linear sensors 20X and 20 Y; 

Figure 6 is a block diagram showing an internal 
arrangement of a linear sensor for X or Y coordinate 
detection; 

Figure 7 is a timing chart of a control signal 



decoding operation; 

Figure 8 is a timing chart at the end of a series of 
operations for decoding a control signal from an output 
signal of a light reception element; 

Figure 9 is a waveform diagram showing an example of 
a waveform output from a linear sensor for X or Y 
coordinate detection ; 

Figure 10 is a waveform diagram showing a skim 
operation in a linear sensor; 

Figure 11 is a flowchart showing a sequence of 
operations for controlling a linear sensor; 

Figure 12 is a flowchart showing coordinate 
calculation processing according to a first e mbodiment; 

Figure 13 is a diagram showing an example of the 
outputs of the elements of a linear CCD sensor; 

Figures 14A and 14B are diagrams showing examples of 
the elements of a linear CCD sensor, Figure 14A 
illustrating setting a threshold value, and Figure 14B 
showing an extraction of effective pixels; 

Figure 15 is a diagram showing a coordinate 
calculation precision of each calculation method; 

Figu re 16 ^i s a flowchart showing a coordinate 
calculation processing according to a secon d embodiment; 

Fig ure 17 is a flowchart showing a coordinate 
calculation processing according to a third embodiment ; 
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Figure 18 is a diagram showing the relationship 
between coordinate calculation precision and XY position, 
using the calculation processing of the second 
embodiment; 

Figure 19 is a diagram showing the relationship 
between coordinate calculation precision and XY position, 
using the calculation processing of the third embodiment; 

Figure 2 0 is a flowchart showing a coordinate 
calculation processing according to the fourth 
embodiment ; 

Figures 21A to 21C are diagrams showing examples of 
modes of selection of effective pixels; 

Figure 2 2 is a diagram showing the relationship 
between coordinate calculation precision and XY position, 
using the calculation processing of the fourth 
embodiment ; 

Figure 23 is a schematic diagram showing an 
arrangement for a front-projection display system; 

Figure 24 is a diagram showing a designation device 
for use in the f ront-pro jection display system of Figure 
23; 

Figure 25 is a block diagram illustrating the 
operational components of the coordinate input apparatus - 

Referring now to the Figures, Figure 1 is a 
schematic block diagram showing an arrangement of an 



optical coordinate input apparatus according to a first 
embodiment- As Figure 1 shows, the apparatus comprises 
a designation device 4 for forming a light spot on a 
screen 10 as a coordinate input plane, and a coordinate 
detection device 1 for detecting position coordinates and 
optionally other parameters associated with a light spot 
5 on the screen 10. In Figure 1 a back-projection-type 
display apparatus 8 etc. for displaying image or position 
information and the like is shown. The back-projection 
type display apparatus 8 functions as an output 
apparatus . 

Figure 2 is a block diagram showing an arrangement 
of a designation device. The designation device 4 
comprises a light emitting element 41 such as a light 
bulb, a semiconductor laser or an LED element for 
emitting a light beam 45, a light emission control unit 
42 for controlling the emission of light, a plurality of 
operation switches 43A-43D, and a power source unit 44 
which is an electric battery in this embodiment. Power 
source 44 may alternatively be a mains connection or a 
manually-operated generator. 

Light emission control unit 42 controls the light 
emitting element 41 to turn ON and OFF at a predetermined 
cyclic frequency, and may also add a control signal to 
the emitted light by modulation methods to be described 



below. As an alternative -to alternating the light 
emission between ON and OFF states, the alternation may 
be between two levels (HIGH and LOW) of brightness. The 
frequency of this alternating intensity is preferably 
high enough to avoid visible "flickering" of the light 
spot when viewed by the user. References to ON and OFF 
states should be construed accordingly to include 
references to HIGH and LOW. The control signal 
modulation applied to the alternating light beam depends 
on the conditions of the operation switches 4 3A to 4 3D. 
The frequency of the control signal modulation should be 
such as to avoid "flickering". Although the designation 
device is shown as having four switches 43A to 43D, other 
numbers and dispositions of switches are possible. 

The coordinate detection device 1 in Figure 1 
detects light emitted from the designation device 4 after 
the light has passed through the screen 10. The device 
1 comprises a coordinate detection sensor unit 2 , a 
controller 3 controlling the coordinate detection sensor 
unit 2 and performing coordinate calculation, a control 
signal detection . sensor (light receiving element) 6, and 
a signal processing unit 7. 

The coordinate detection device 1 detects a 
coordinate of a position of a light spot 5 on the screen 
10 and a control signal corresponding to a condition of 



each switch 4 3A to 43D of the designation device 4. The 
coordinate detection device 1 communicates the detected 
information to an external device such as a computer 200 
via an output means 3A. The external device may be a 
personal computer comprising a processing unit 201 having 
RAM 202 and ROM 203 memories for storing data and 
programs etc., input devices such as keyboard 204 and 
mouse 205, a disk drive 206 for reading and writing data 
to a removable disk 2 07, and a display 20 8. A printer 
209 may optionally be connected to the computer 200, and 
a modem 210 may provide for communication via a network. 

The computer 200 connected to the coordinate 
detection device 1 receives the detected information 
transmitted from output means 3A analyses a coordinate 
and a control signal included in the received information 
and generates a command based on the analysis. The 
computer 200 may execute an operation depending on the 
command, or may transmit the command to an external 
device. The operation may be an instruction to the 
display 208, modem 210, printer 20 9 or memory drive 2 06. 
The instruction may be to display images or text on 
display 208, to send to or receive from other devices 
some information via modem 210, to print out images or 
text by printer 209 or to store some information to disc 
207, which is detachable with computer 200, by memory 



drive 206. The memory 207 may be a floppy disc memory, 
a compact disc memory or an optical memory etc. 

Computer 200 may identify an icon where the 
coordinate designates and then generate a command 
corresponding to the type of icon and the control signal 
transmitted by the light beam. The icon is identified 
based on a relation between coordinates and command icons 
stored in a memory within the computer 200. 

In the above, computer 2 00 receives a coordinate 
transmitted from output means 3A, but when coordinate 
calculation unit 32 is arranged in computer 200, computer 
200 receives the output of AD conversion 31A and is 
arranged to set the threshold value, select effective 
difference data and calculate the coordinates. 

The back-projection type display apparatus 8 
comprises an illumination optical system and a projection 
lens. The illumination optical system includes an image 
signal processing unit 81, which is adapted to receive an 
image signal output from the external device 2 00 and to 
provide a control signal to drive a liquid crystal panel 
82. The display apparatus further comprises a lamp 83, 
a mirror 84 and a condenser lens 85. The back-projection 
type display apparatus 8 is capable of displaying a 
desired image on the screen 10. The screen 10 has a 
suitable light diffusion for increasing a visible range 



of a projection image. A light beam emitted by the 
designation device 4 is also transmitted and diffused at 
a light spot 5- The coordinate detection device 1 
receives a part of the diffused light independent of the 
position of the light spot on the screen and of the 
direction of the incident light beam 45 from the 
designation device 4 relative to the plane of the screen 
10. 

The coordinate input apparatus according to this 
embodiment is capable of inputting character information 
and line and image information on the screen 10 by moving 
the light spot 5 over the screen, and by modulating the 
light beam emitted by the designation device 4 using the 
switches 43A to 43D. The coordinate information and 
modulation information associated with the light spot 5 
is transmitted to the computer 200 via the output means 
3A. This information is processed and may influence the 
image signal sent from the computer 100 to the signal 
processing unit 81, to display the information by using 
the projection type display apparatus 8- The designation 
device 4 may thus be used as an information input/output 
device to move a cursor displayed on the screen, to 
designate a button displayed on the screen 10 or to 
perform an input operation by selecting an icon. An 
optical coordinate input apparatus according to this 



embodiment is described in detail below. 

The light emission control unit 42 controls a light 
emitting element 41 to turn the light ON and OFF (or to 
alternate the light emission between HIGH and LOW 
intensity states), and to add a control signal to the 
light by modulation methods described below. The nature 
of the control signal depends on a condition of the 
operation switches 43A to 43D. A truth table showing the 
relationship between the switch inputs of the designated 
device 4 and the control signals is shown in Figure 3. 

In Figure 3, Switch A-D corresponds to switches 43A- 
43D in Figure 2, "light emission" corresponds to 
emission of an alternating light beam from element 41 , 
producing a light spot 5, while "pen down" and "pen 
button" correspond to control signals transmitted by 
modulating the alternating light beam. 

An operator grasps the designation device 4 and 
points it at the screen 10. The switch 43A is arranged 
at a position convenient for the operator's thumb. When 
the switch 43A is pushed, the light beam 45 is emitted. 
The light spot 5 is generated on the screen 10 and a 
coordinate signal output is started. In this situation, 
the control signals for pen down and pen button are in 
the OFF condition- Therefore only a coordinate position 
on the screen is indicated at output 3A. 
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The switches 4 3C and 4 3D, are arranged at positions 
convenient for the operator's index finger and middle 
finger, respectively. When these switches are pushed, 
then control signals corresponding to pen down and pen 
5 button are added to the light beam 45 as shown in Figure 

3. Namely, when the switch 43C is pushed, the "pen down" 
l;3 control signal is sent via the light beam 45. Then the 

'■'/is? 

in display controlling functions, such as to input 

ly 

1.0 characters, lines and images, or to select and operate 

io buttons displayed as icons on the screen, become 

available . 

When the switch 4 3D is pushed the "pen button" 
control signal is sent via the light beam 45. Another 
ts function such as calling a menu may then become 

15 available. Therefore the operator can quickly and 

accurately draw characters and images at the desired 
position on the screen 10 and can select and operate 
buttons and menus so that an efficient operation becomes 
possible. 

2 0 If the designation device 4 is to be used only as a 

direct input device, i.e. it's not to be used as a 
pointer but only to be used in contact with the screen, 
it is not necessary to produce a light beam, and a 
diffusion light is available as the light source for the 
25 designating device. It is then possible to use a lower 
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cost and longer life LED rather than a semiconductor 
laser - 

The system shown in Figure 1 is a back projection 
system, namely the structure the display apparatus is 
positioned behind the screen 10 (on the opposite side of 
the screen from the operator) . The image output from the 
display apparatus is projected onto the screen from 
behind. The light emitted by the designation device 4 
reaches the coordinate detection device 1 after passing 
through the screen 10. On the other hand, front type 
projectors such as that shown in Figure 23, which 
projects an image output from a display apparatus onto a 
wall of a room or onto an opaque screen, have become 
common, and this invention can be used with such a 
system. 

The structure of the coordinate detection device 1 
is similar to that used with the back-projection type 
system explained above, and consequently its detailed 
description is omitted here. The position of the light 
has to be detected without the light passing through the 
screen 110 in the embodiment of the front projection type 
system. The structure of the designation device 140 for 
use with a front projection display system is described 
with reference to Figures 23 and 2 4 below. 

The designation device 14 0 comprises an elongate 
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telescopic centre section C, at one end of which is a 
grip part 140a, The grip part houses operating switches 
143A, 143C and 143D, as well as internal operating 
components namely a power source 144 and a light emission 
5 control unit 142. A light emitting source 41 is arranged 

in a tip portion situated at the other end of the centre 
13 section C. The tip portion 14 6 comprises a light 

emitting element 141, a switch 143B, and a transparent 

is - 

y 

f\ protective cover 147 . The light emitting element 141 and 

y io the cover 147 are so configured that when the switch 143B 

; is placed in contact with the screen 110, light emitted 

U from the light emitting source 141 is directed away from 

IP the screen 110- In this system therefore a part of the 

9 emitted light 145 can reach the coordinate detection 

15 device 1 without the passing through the screen 110. The 

switch 143B is operated by being pressed onto the screen 
110, and this causes the light emitting source 141 to 
start the light emission. Part of the light emitted from 
the light emitting source 141 reaches the coordinate 
20 detection device 100 through the protective cover 147, 

and the light can reach the coordinate detection device 
100 even if the designation device's orientation is 
changed, since the protective cover 147 has a light 
diffusion feature and a lens effect causing the light 145 
25 to be emitted as a broad beam directed substantially 
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perpendicularly to the length direction of the 
designation device 140- Each operational component of 
the designation device 140 shown in Figure 24 performs 
the same function as its correspondingly numbered 
counterpart in the designation device of Figure 2. 

For example r when a projection type display 
apparatus without the coordinate detection apparatus and 
the designation device is used in a meeting, the speaker 
should not stand between the projection type display 
apparatus and the screen in order to avoid blocking the 
light from the projection type display apparatus. A tool 
such as a pointer is used to draw attention to an area of 
the screen. Moreover, for a smooth running presentation, 
the speaker moves to the computer controlling the 
displayed image to input a control to change the image, 
or another person is required for inputting control data 
to the computer when the displayed image on the screen 
has to be changed. 

However the system shown Figures 23 and 24 enables 
the speaker to add information to the displayed image and 
input position information of a desired position without 
approaching the computer. Additionally, the input can 
work in the same way as a conventional screen mouse, and 
by clicking on an icon such as a command input button, 



the user can control the computer without moving and 
without another person's help. 

The switch 43B of the designating device of Figure 
2 is arranged at the distal end of the designation device 
4. Similarly the switch 143B of the designating device 
of Figure 24 is arranged at the distal end of the 
designation device 140 (i.e. the end remote from the grip 
140a). The switches 43B and 143B are both operated by 
being pressed on the screen 10 or 110. The operator 
grasps the designation device 4 or 14 0, presses the end 
or tip of the designation device on to the screen 10 or 
110 and the "pen down" control signal is applied to the 
light beam emitted from the designating device 4 or 140. 
The coordinate detection sensor units 2 detect the 
position of the light spot 5, and the control signal 
detection sensor 6 detects the control signal applied to 
the light beam. As can be seen from the table in Figure 
3, when the light emission is ON and the designating 
device is pressed on to the screen, both a position 
signal and a control signal are transmitted via the light 
beam. Then an extra switch operation is unnecessary for 
spontaneous input pen operations. 

The switch 43A or 143A plays a part of a pen button. 
Pushing the switch 43A without pressing the designating 
device onto the screen can provide only a position 



signal, which may be used in -the external device -to 
control the position of a screen cursor. In reality, to 
input characters and images by touching directly on the 
screen is much better in operation and more accurate than 
to operate far from the screen. This embodiment can 
realize a spontaneous and comfortable operation in a 
position close to the screen or a position far from the 
screen by using four switches as described above and the 
switches are used according to the situation. 

The light emission controller 42 may be configured 
to transmit an individual identifying signal such as an 
ID number as part of the modulation of the light beam 45 
or 145, so that two types of designation devices 4 and/or 
140, such as a contact designation type and a remote 
designation type can be used, or so that two or more 
operators can use designation devices at the same time, 
or a plurality of designation devices 4 or 140 having a 
different attributes in colour or line width can be used. 
Software of an externally connected device may be 
arranged so that attributes of drawing lines in colour or 
width are made to correspond with lines drawn by a 
particular device 4 or 14 0 in accordance with the ID 
number of that device. The line attributes for each 
device may be set and changed by using a button or menu 
on the screen. Alternatively the software may be 



arranged to transmit a change control signal by using an 
extra operation button arranged on the designation device 
4 for that operation. A further alternative arrangement 
is to store in the designation device 4 or the coordinate 
detection device 1 data corresponding to line attributes 
etc of each designating device and to transmit this data, 
rather than the designating device's ID number, to the 
external device. 

The extra operation button such as described above 
can be used for another function. For example to flash 
on and off on a display apparatus, to switch a signal 
source, to control a video recorder or other device 
connected either to the external device (the computer 
200) or connected directly to the coordinate detection 
device 1 via an auxiliary output port separate from port 
3A. Further, if a pressure detection means is provided 
for either or both of the switches 43A and 43B (or 143A 
and 143B), this allows the detection of a writing 
pressure and the transmission of the writing pressure 
with the control signal. In this way, various useful 
signals can be transmitted to the coordinate detection 
device 1 . 

The light emitting starts in accordance with 
changing to ON condition of either the switch 4 3A or 
switch 43B of the designation device 4, and a light 



emission signal such as the LSG signal shown in Figure 7 
is output. Namely, in the light emission signal of this 
embodiment, a header part comprising a comparatively long 
leader part (LEADER, having a continuous pulse sequence 
and codes such as a manufacturer ID is output at first. 
After that the transmission data sequences comprising a 
pen ID and control signal etc. is output in a 
predetermined order and format. 

In this embodiment, a "1" bit signal is defined by 
a clock interval in which light is received followed by 
three clock intervals in which no light is received. A 
"0" bit signal is defined as a clock interval during 
which the light is received followed by a single clock 
interval of no light. In this modulation format, the »l« 
bit requires twice the interval of "0" bit for 
transmission (four clock intervals as opposed to two). 
Various data modulation formats are usable. As will be 
explained below, it is necessary to keep a constant light 
value average for effective coordinate detection, and for 
the clock intervals of the control signal modulation to 
be large enough for PLL tuning, in a consideration that 
a comparatively high redundancy doesn't create 
significant difficulty in a data amount to be 
transmitted, 6bit (64, data are modulated to 108 codes 
within 10 bits length codes in which equal numbers of »l» 



and "0" bits are present: and the number of consecutive 
"l"s or "0"s is three or less in this embodiment. 
According to this modulation method, a stable sync signal 
can be generated easily since an average of voltage is 
kept constant and the large clock intervals are included. 

The control signals indicative of a "pen down" and 
"pen button" require 2 bits as described above, but other 
long data such as an ID code has to be transmitted. In 
this embodiment, one block of 24 bits comprising a 
control signal for the first 2 bits, a contents 
identification code for the next 2 bits (for example "00" 
means a writing pressure, "11" means an ID and so on), 
then a parity signal for the next 2 bits, data for the 
next 16 bits and a further parity signal for the next 2 
bits. When data is modulated like this by using the 
above described method, a signal 40 bits in length is 
generated. A sync code having 10 bits length is added to 
that. The sync code has a pattern with four consecutive 
0 codes and five consecutive 1 codes. The pattern is 
changed to an opposite pattern in accordance with whether 
the end of the last block is 1 or 0. By using that 
special code, the identification of a data word is 
performed easily, and the position is identified 
accurately even in the middle of the data sequence. Then 
decoding can be performed. Therefore the transmission 



signal has 50 bits length for one block and can transmit 
a control signal, ID, data and writing pressure, etc.. 

In this embodiment, however the frequency at which 
the intensity of the light varies (the "first frequency") 
is set to 60 kHz and the frequency of the clock intervals 
in the control signal modulation (the "second frequency") 
is set to 7.5 kHz which is 1/8 of the first frequency - 
Since the modulation is performed by the above method, an 
average of transmission bit rate is 5 kHz which is 2/3 of 
the second frequency. One block has 50 bits. The 24 
bits data are transmitted as one block at 100 Hz. 
Therefore an effective bit rate exclusive parity is 2000 
bits /sec. The redundancy is high with this method, but 
communication can be effected in a simple structure that 
can avoid incorrect detection and synchronize very 
easily. 

By using both a phase synchronized signal for a 
sensor control described below and checking the sync code 
repeat cycle, the signal can be followed even if a short 
drop out occurs in the signal . The presence or absence 
of a header signal is used to distinguish between a drop 
out and the quick operations of "pen up" and "double 
click" . 

The Coordinate Detection Device 1 

Figure 4 shows an internal arrangement of the 



coordinate detection device 1. The coordinate detection 
device 1 has a sensitive light receiving element 6 for 
detecting a luminous energy by using a condensing optical 
system, and two linear sensors 20X and 20Y for detecting 
a direction of a light source by using an imaging optical 
system. The linear sensors constitute a coordinate 
detection sensor unit 2. 

The operation of the coordinate detector is the 
same, irrespective of whether the back-projection or 
front projection display device is used. The following 
description will refer to the back-projection embodiment, 
but it is to be understood that the detection of the 
position of the light spot is carried out in the same 
manner in the front projection arrangement. 

The coordinate detection device 1 receives light 
diffused from the light spot 5 generated on the screen 10 
by a light beam from the light emitting element 41 within 
the designation device 4. A controller 3 constitutes a 
sensor control means 3, an AD conversion unit 31A, a 
coordinate calculation unit 32 and a communication unit 
33. Controller 7 (Signal processing unit) constitutes a 
frequency detection unit 71 and a control signal 
detection unit 72. The function of each unit will be 
clear from the description below. 

(Description of Imaging Optical System Operation) 
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An imaging lens is attached to the light receiving 
element 6 as an imaging optical system (Figure 1), and 
detects with high sensitivity a luminous energy of a 
predetermined wavelength over the entire area of the 
screen 10. After the detection output is detected by the 
frequency detection unit 71, a digital signal, which 
includes data such as a control signal (the signal is 
added by the light emission control unit 42 of the 
designation device 4), is decoded in the control signal 
detection unit 72 . 

The operational components of the coordinate 
detection device 1 are illustrated in Figure 25. The 
apparatus comprises a Central Processing Unit (CPU) 3 01 
for controlling and executing the processing operations, 
and memory 302 for storing the control programs and 
various data generated in each operation. The control 
program for executing the operations shown in the 
flowcharts of Figures 12, 16, 17 and 2 0 are stored in the 
memory 302 and the CPU 301 executes the operations based 
on the control programs. Therefore the operations of the 
coordinate calculation unit 32, frequency detection unit 
71 and control signal detection unit 72 seen in Figure 4 
are executed by the CPU 301. The programs are preferably 
stored in the memory 302 before the operation starts, by 
reading them from a data carrier such as a floppy disk or 



CD ROM or by downloading from an external source via a 
modem 210 connected to a communications network (see 
Figure 1 ) . 

When the memory 3 02 is connected for communication 
with the CPU 301, the operation based on the control 
program stored in the memory 302 can be executed. 
Communication interface 3 03 controls the communication 
between the apparatus and an external device such as 
computer 200, an information processing unit, movable 
device, telephone etc. (not shown). The communication 
interface 303 controls transmitting and receiving of 
signals and data. The signals and data may be received 
and transmitted through a network such as public 
communication service, Internet, LAN (Local Area Network) 
between the apparatus and external devices. Input 
interface 304 for controlling signals and data input and 
output interface 305 for controlling signals and data 
output. Sensor 306, sensor control unit 307 and AD 
converter 30 8 corresponds to the units 2, 31 and 31A in 
Figure 4 . 

In Figure 25, the apparatus comprises a sensor 306, 
sensor control unit 3 07 and AD converter 3 08, but the 
sensor 306 can be arranged in a separate device from the 
remaining components. In the case, the input interface 
304 receives signals transmitted from the sensor 306 and 
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sends them to the sensor control unit 3 07 or AD converter 
308, and the output interface 305 transmits a control 
signal and data from the sensor control unit 307 to the 
external sensor 306. Further, not only the sensor 306 
but also the sensor control unit 3 07 or AD converter 308 
can be arranged in another external device. In the case, 
the input interface 304 receives signals and data 
transmitted from the sensor control unit 30 7 or AD 
converter 308 and sends them to other internal units, and 
the output interface 305 transmits signals and data from 
other internal units to the sensor control unit 307 or 
the AD converter 308. The operations of the input 
interface 304 and output interface 305 for communicating 
between the apparatus and the external devices are 
controlled by the CPU 301. Each unit of the apparatus of 
Figure 25 is connected with bus 309 then signals and data 
can be transmitted between any two units. 

The apparatus shown in Figure 25 may include a 
display device for displaying an image or message showing 
a condition of operation or input signal and data, and an 
input device such as a key board or a pointing device for 
inputting an instruction for controlling the operations. 

Figure 7 is a timing chart describing a decoding 
operation of a control signal. The signal constituted by 
the bit sequence described above is detected as a light 



output signal LSG in the light receiving element 6 and 
detected in the frequency detection unit 71. The 
frequency detection unit 71 is structured to tune with a 
pulse cycle of the first frequency in the light output 
signal LSG, and it decodes a modulation signal CMD 
without influence of the ambient light by using it with 
an optical filter. This detection method is the same as 
the manner of an infrared remote controller used in broad 
practice, and is a highly reliable wireless communication 
method. in this description, the first frequency is 60 
kHz that is a higher frequency than is usually used with 
infrared remote controllers, so that an incorrect 
operation should not occur if a conventional infrared 
remote controller is used simultaneously. The first 
frequency can, however, be in a frequency range of the 
usual infrared remote controller. in this case, 
incorrect operation can be avoided by an identification 
of an ID signal. 

The modulation signal CMD detected by the frequency 
detection unit 71 is analysed as digital data by the 
control signal detection unit 72 and the control signals 
such as "pen down" and "pen button" described above are 
decoded. The decoded control signals are sent to the 
communication control unit 33. The code modulation cycle 
included in the modulation signal CMD is detected as the 



second frequency by the sensor control unit 31 and the 
linear sensor 20X and 20Y. Namely, each unit is reset on 
the timing of header part shown in Figure 7, after that 
a signal LCK phase synchronized with a falling edge of 
the modulation signal CMD is generated. Therefore, the 
generated signal LCK has a constant cycle and is 
synchronized with a light luminance of the designation 
device 4. A signal LON is generated to be high when the 
light spot is present, and low when the designating 
device projects no light, and a sensor reset signal RCL 
is triggered by the signal LON is generated from the 
modulation signal CMD. The linear sensors 2 OX and 20Y 
are reset while the modulation signal CMD is on a high 
level and synchronized integration operation is started 
at the falling edge of the sensor reset signal RCL 
synchronized with the rising edge of the signal LON. 

The control signal detection unit 72 detects the 
header part of the signal then confirms a start of input 
from the designation device 4, and not from another 
device or noise. it is identified, then the 

identification signal is transmitted from the 
communication control unit 33 to the sensor control unit 
31, a signal CON showing linear sensors 20X and 20Y 
operations are effective is set on high level and an 
operation in the coordinate calculation unit 32 is 



started. 

Figure 8 shows a timing chart at the end of a series 
of operations after the light output signal has stopped. 
If the modulation signal CMD detected from the light 
output signal LSG keeps low level for a predetermined 
period or more, the signal LON which shows the presence 
or absence of the light spot changes to low level and the 
signal CON which shows sensor operation is effective also 
changes to low level. The result is that the coordinate 
output operation of linear sensors 2 OX and 2 0Y ends. 
(Description of Imaging Optical System Operation) 

Figure 5 is a diagram showing an arrangement of the 
linear sensors 20X and 20Y. The images (91X, 91Y) of the 
light spot 5 are created as lines each falling 
transversely across a respective linear array of sensors. 
Each sensor corresponds to a pixel of the array. The 
linear images of the light spot are formed on the 
sensitive parts (21X r 21Y) of each sensor array by 
respective cylindrical lenses 90X and 90Y as a imaging 
optical system. By arranging that the axes of the 
cylindrical lenses make a right angle exactly, each 
output has a peak at a pixel corresponding to an X 
coordinate or a Y coordinate. These two sensors are 
controlled by the sensor control unit 31, the output 
signal is converted to a digital signal by the A/D 



conversion unit 31A connected with the sensor control 
unit 31, and is sent to the coordinate calculation unit 
32. 

The coordinate calculation unit 32 calculates an 
output coordinate value from the digital signal and 
supplies the result to the control signal detection unit 
72. The control signal detection unit 72 sends the 
coordinate value from the coordinate calculation unit 32 
to an outside control apparatus (for example computer 
200) by a predetermined communication method through the 
communication control unit 33 with data such as a control 
signal. 

A mode switch signal is sent from the communication 
control unit 33 to the sensor control unit 31 and the 
coordinate calculation unit 32 for an unusual operation 
such as adjustment (for example a setting of user 
correction value). 

In this embodiment, focus is adjusted so that the 
linear image of the light spot 5 has a width which is a 
number of times greater than the width of a pixel in each 
sensor and the image is shaded off intentionally. In an 
experiment using plastics cylindrical lenses with sensor 
arrays having 1.5pm pixel pitch and 64 effective pixels 
and infrared LED, if the sharpest image is created, the 
image has 15pm or less width within all available degree 



40° and it is clear that a separated calculation result 
between pixels makes distortion in this situation. And 
if a position of lens is adjusted as an image has 3 0/im to 
60 jim more or less in width, very smooth coordinate data 
can be obtained. Of course a peak level is too small if 
a vignette is too large, then a vignette will be best in 
some pixel width. One of this embodiment's points is to 
use a CCD having a small number of pixels, and an optical 
system which gives a linear image covering a suitable 
number of pixels. A coordinate input apparatus which 
needs a small calculation capability, a small sensor and 
optical system, and provides reliable detection, high 
precision and high speed is realized by using that 
combination . 

A linear sensor 2 OX for X coordinate detection and 
a linear sensor for Y coordinate detection are arranged 
in array and have the same structure. Only linear sensor 
2 OX for X coordinate detection is described below. 
Figure 6 is a block diagram showing the internal 
arrangement of the linear sensor. 

The sensor array 21 as the light receiving part is 
constituted by N pixels (64 pixels in this embodiment) 
and electric charges corresponding to the amount of light 
received at each pixel are stored in the integrating unit 
22. The integrating unit 22 has N parts and can be reset 



by addition of a voltage at gate ICG, allowing an 
electric shutter operation to be effected- The electric 
charge stored in the integrating unit 2 2 is transmitted 
to a storage unit 23 responding to an addition of a pulse 
voltage at an electrode ST. The storage unit 2 3 has 2 x 
N parts and stores electric charge separately 
corresponding to H(high level) and L(low level) of the 
signal LCK synchronized with a light emitting timing of 
the designation device 4. As a result, for each pixel an 
electric charge corresponding to the light emission state 
and a charge corresponding to the light non-emission 
state is stored. After that, the separately stored 
electric charges synchronized with the light flashing on 
and off (or alternating between HIGH nd LOW intensity) 
are transmitted to the linear CCD unit 2 5 having 2 x N 
parts through the shift unit 24, which is arranged to 
make a simple transmission clock having 2 x N parts. 

Therefore electric charges corresponding to sensor 
outputs in light emission state and light non-emission 
state are stored for all 64 pixels contiguously in the 
linear CCD unit 25. The electrical charges arranged in 
the linear sensor unit 25 are transmitted sequentially to 
the ring CCD 2 6 having 2 x N parts. The ring CCD 2 6 is 
cleared at CLR 2 7 responding to the single RCR and from 
the linear CCD 25. 



The stored electric charges are read out by an 
amplifier 29. The amplifier 29 outputs a voltage being 
in proportion to the stored electric charge amount. In 
practice, it outputs a difference of electrical charge 
amount between adjacent stored values, i.e. an amplified 
amount corresponding to the difference between the 
electric charge amount of a pixel in the light emission 
state of the light emitting element 41 and the electric 
charge amount of that pixel in the light non-emission 
state, for each of the N pixels. 

Figure 9 is a diagram showing an example of a 
waveform output from linear sensors 2 OX and 2 0Y. In the 
figure, the vertical axis relates to charge amount, and 
the horizontal axis to pixel position. Waveform B shows 
a signal read out in the light emission state of the 
light emitting element 41, and waveform A shows a 
waveform in light non-emission state, i.e. it shows only 
the ambient light waveform. (As described in relation to 
Figure 6, the electric charges corresponding to these 
waveforms A and B are stored contiguously in the ring CCD 
26.) However since amplifier 29 outputs an amplified 
difference between the adjacent electric charge amounts 
(waveform B-A), a signal representing only light from the 
designation device 4 can be obtained and a stable 
coordinate input without any influence of the ambient 
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light is available. 

A maximum value of B-A waveform shown in Figure 9 is 
also defined as the PEAK value. If a storage period for 
the sensor function against light is increased, i.e. if 
5 charge is allowed to build up by adding together charge 

values for successive clock intervals , the PEAK value is 
.j (a * increased correspondingly to the period increase. In 

• % other words, if a cycle period of the signal LCK is used 

1 5 as a unit storage period, the number of storage times n 

jln 10 is defined by using the unit storage period and the 

number of storage times n is increased, then the PEAK 
|7i value is increased. By increasing the detection time 

'ip until the PEAK value reaches a predetermined value TH1, 

an output waveform having stable quality at all times can 
15 be obtained. 

If the ambient light is very strong, a transmission 
electric charge of the ring CCD 26 threatens to be 
saturated before a peak of the difference of wave B-A 
becomes sufficiently increased. To combat this effect, 
20 the sensor is provided with a skim unit 28 having a skim 

function. The skim unit 2 8 senses the signal level in 
the light non-emitting state (i.e. the ambient light), 
and if the signal level exceeds a predetermined value 
(the level is shown by a dot and a chain line in Figure 
25 10) at an n-th clock interval An as shown in Figure 10, 
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a predetermined value of electrical charge is removed 
from the stored electrical charge in each pixel. 
Therefore the waveform An+1 is obtained at the next 
(n+lth) clock interval- By repeatedly subtracting charge 
5 until the signal is below the threshold, even if the 

ambient light is strong, saturation won't occur. 
Therefore, even if the luminous energy of the light flash 

: -.t=£ 

15 on and off is weak, a big enough signal waveform can be 

in obtained by repeating the integral operation a number of 

3*3 

1*0 10 times. Especially in the case where a visible ray range 

light source is used in the designation device 4, a 
yj signal of a displayed image is added then a sharp 

~p waveform including a minimum of noise can be obtained by 

using the skim function and difference output as before. 
15 If very strong ambient light is reached, the PEAK value 

is monitored and the storage operation can be stopped 
when the PEAK value reaches a predetermined level. 
Namely in this case, an output waveform having enough 
quality can be obtained without the storage operation 
2 0 increasing, and a reliable coordinate calculation can be 

made in a comparatively small number of the storage 
operation times. This gives the advantage that the 
coordinate calculation sampling rate per unit of time 
becomes higher if input light is weak (for example, the 
25 coordinates can be calculated in higher speed of 40 
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points per second than 20 points per second in the other 
situation. ) . 

Figure 11 shows a flow chart of the operation for 
controlling the linear sensors 20X and 20Y. At first the 
sensor control unit 31 starts a sensor control operation 
in step S101 and monitors a signal CON in step S102. If 
the signal CON changes to high level, a counter pon is 
set to 1 and sets the number of storage times n to 0 in 
step S103 and judges whether a PEAK value (peak level) of 
sensor output is larger than a predetermined value TH1 or 
not in step S104. 

If the peak value is smaller than TH1, the flow 
passes to step SI 05 where it is determined whether the 
number of storage times n is more than a predetermined 
number of times nO . If it is not, the flow shifts to 
step S106 and increments the number of storage times n by 
one and returns to step S104. The flow shifts to step 
S107 after the PEAK value becomes bigger than TH1 or the 
number of storage times n is more than a limit value nO 
then the integral operation stops. A coordinate 
calculation operation by the coordinate calculation unit 
32 then starts. The coordinate calculation is described 
below. 

After that, if the counter n is over a second 
predetermined number of times nl in a loop of step S108 



and step S109, the integral stop signal RON changes to 
low level, at the same time the sensor reset signal RCL 
is in high level for a number (two in Figure 8) of cycle 
periods of the signal LCK(step S110). After that the 
flow shifts to step S112 and the operation is repeated 
while the signal CON is in high level then the coordinate 
calculation is done in each cycle controlled by the 
predetermined number of times nl. 

Step Sill is for keeping a condition against at 
least one signal CON dropping due to the influence of 
dust. If the signal CON is at low level for two 
consecutive cycles, the flow shifts from step S102 to 
step S113, the counter pon is reset to 0 and returns to 
step S101 after a sync waiting condition has made. 

This dropout countermeasure operation can be longer 
than one cycle, and it is also removed if ambient 
background is negligible- If this cycle changes to a 
natural number of times the cycle of the data block 
described above, it corresponds to the timing of sync 
code and not the signal CON but if a sync code detection 
signal is used similar operation can be realized. 

The same effect can be obtained by using a natural 
number times of the data block as one cycle, 
synchronizing the timing with the sync code timing and 
using a detection signal of the sync code in place of the 



signal CON. The light of the designation device 4 
reaching the coordinate detection device 1 changes, in 
response to a consumption of an electric source (changing 
electric battery voltage) arranged in the designation 
device 4, and also in dependence on the orientation of 
the designation device 4. Especially if a light 
diffusion of the screen 10 is low and the front 
brightness of displayed image is increased, however, the 
change of luminous energy input to the sensor varies 
depending on the relative positions of the light spot and 
the designation device 4. But in this embodiment, even 
in this case, the number of integration times is varied 
automatically to compensate for this effect, and a stable 
output signal can be obtained at all times. This brings 
the result that reliable coordinate detection can be 
obtained. If the beam of the laser pointer is pointed 
directly at the sensor, then a strong light is input but 
even in this case, the stable coordinate detection can be 
obtained clearly. 

If a pen having an LED light source is used in a 
direct screen contact condition and the laser pointer is 
used, since the LED will have a larger luminous energy 
then the numbers of integral times nO and nl shown in 
Figure 11 can be adjusted, depending on whether the 
active designation device is a pen or a pointer. In this 



case, the determination as to whether the designation 
device is a pen or a pointer can be realized based on the 
ID signal supplied by the respective designation device 
when active- This allows high speed sampling to be used 
when the pen is active and low speed sampling to be used 
for the pointer- In practice, a delicate drawing 
operation such as character input can not be done by the 
pointer. Better use of the pointer can be obtained in 
smooth line drawing operation provided by low sampling 
rates - 

As above, a high frequency control signal is added 
to the flashing light and the integral operation timing 
is controlled by the predetermined cycle decode signal 
obtained by the frequency detection of the carrier- Then 
the designation device and the image input unit are 
synchronized in a wireless condition and a useful 
coordinate input device can be realized. 

The use of a laser beam allows a user far from the 
screen to operate the display easily. By the integral 
control unit steps the integral operation responding with 
a detection that the peak level in the difference signal 
from the integrating unit is over the predetermined 
level, the signal of light spot image having a stable 
level can be generated even if the luminous energy has 
changed. Therefore, stable and reliable detection 



coordinate calculation results can be obtained at all 
time. The method for keeping the quality constantly 
independent on the amount of luminous energy input to the 
sensor was described above, but one problem is risen. 
The luminous energy changes responding to the consumption 
of the electric source (electric battery) arranged in the 
designation device 4, and also the luminous energy change 
responding to the orientation of the designation device 
4 relative to the screen, namely a tilt of the 
designation device by the usual writing operation for 
inputting a coordinate, and a conversion efficiency 
difference between each sensor or light emission element 
etc. is expected as above. If the light incident on the 
detector is decreased, the signal waveform having good 
quality can be obtained by setting a longer integral time 
dependent on incident light levels namely by setting 
bigger nO and nl and increasing the times of integral 
operation. However the increase of the time of integral 
operation leads to a decrease of a coordinate sampling 
rate namely the number of coordinates calculated in a 
unit of time, then there is a limit for recreating a 
user's writing accurately as a coordinate input device of 
this invention. For example, if a sampling rate of 25 
points per second is necessary for accurately recreating 
waiting, the time for one coordinate calculating 
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operation must be 4 0 msec or shorter and the peak level 
must reach the predetermined peak level of the signal 
waveform in the available integral time. But if a 
coordinate having a high reliability for the operator can 
be obtained even if the predetermined peak level can not 
be obtained, a designation device having good writing 
properties for the operator can be realised for example, 
the tilt of the designation device can be bigger, or 
battery life may be increased. This invention is for 
that, then the operation is described below. 
(Coordinate calculation) 

The coordinate calculation operation in the 
coordinate calculation unit 32 is described below. 

The output signal (difference signal from amplifier 
29) for each of the linear sensors 2 OX and 20Y as above 
is sent to the coordinate calculation unit 32 after 
conversion to a digital signal by the AD conversion unit 
31A arranged in the sensor control means 31, and 
coordinate value is calculated. At first the coordinate 
on sensor (X1,Y1) corresponding to each output data of X 
coordinate and Y coordinate are obtained in the 
coordinate value calculation. Only the calculation 
related to X coordinate will be described below, since 
the calculations related to the X coordinate and the Y 
coordinate are similar. 
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Figure 12 is a flowchart showing coordinate 
calculation processing according to a first embodiment. 
The coordinate calculation processing starts, and the 
variable cont is set to 0 in step S2 01 at first. The 
variable cont is used in standard point setting mode (as 
below). The difference data Dx(n) (the number of pixels 
n=64 in this embodiment) means a signal representing the 
difference between the output value of a pixel in the 
light emission state and light non-emission state. For 
each pixel of desired coordinate input position 
(predetermined known position in a standard point setting 
mode as below) the difference data Dx(n) is got in step 
S202 and stored in a buffer. The Dx(n) data for each 
pixel is compared with a predetermined threshold value V 
and data value Ex(n) which is an excess value being over 
the threshold value is obtained in step S203 for each 
pixel. 

The coordinate XI on the sensor is calculated by 
using the Ex(n) data from step S204. For this 
calculation, a centroid position of output data is used 
in this embodiment but alternative calculation methods 
such as peak value calculation, for example by 
differentiation, can be used. 

The mode of coordinate calculation processing is 
decided in step S205. A predetermined reference value 



must be decided before a' calculation for a coordinate 
based on a centroid position XI of output data, and the 
predetermined reference value calculation (reference 
point setting mode) is described below. 

The matter about X direction is described. The 
light spot from the designation device 4 is sequentially 
positioned at two setting points on the screen 10, which 
have known X coordinate and Y coordinate values «0, (30 
and orl, pi, and the steps S202-S2 04 are operated to 
obtain two respective centroid values Xl 0 , and X^ on the 
X direction sensor. The centroid values Xl 0 and Xl 1 and 
the known coordinate values c<0 and al are stored in step 
S210. The operation is repeated twice to obtain signals 
Xl 0 and Xl x corresponding to positions otO and al. 

In normal coordinate calculation mode, the X 
coordinate of the coordinate input point is calculated in 
step S206 by using the values (Xl 0 , xi a , a0 and al ) 
stored in step S210, in accordance with the formula or 
S210. If necessary, a coordinate correction, for example 
a distortion correction by software calculation to 
compensate for an aberration of the optical lens, is done 
and the corrected coordinate value is output from step 
S207 because higher level coordinate input device can be 
supplied. 
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The Y coordinate calculation is performed in the 
same way, using the values (3 0 and (31 instead of oeO and 
al. 

In the above processing, calculated and optionally 
calculated coordinates can be output in real time or the 
coordinates can be thinned out responding to the purpose, 
for example one output out of every ten calculated 
coordinates actually being used. The choice is important 
in the cases below. 

The user's hand stability differs depending on 
whether the designation device 4 is used as a pen or as 
a pointer. When as a pointer to project a spot onto the 
screen from afar, the light spot trembles on the screen, 
and this trembling should be repressed for better use. 
When used as a pen, tracking of the light spot is 
required to be as accurate and as quick as possible. 
Especially if a character is written, quick operation is 
necessary for accurate input. 

Since ID is transmitted by using control signals in 
the embodiment of Figure 2, it can be determined whether 
the device is used as a pointer or a pen by detecting 
whether the end switch 43B is pressed or not. When the 
device is used as a pointer, a current output coordinate 
(X,Y) may be obtained by extrapolation from the previous 
coordinate values (x-l,Y-l) and the coordinate values (X- 



2, Y-2) preceding them. A useful structure having little 
error is realized. The movement mean is used in this 
embodiment, but other methods wherein the absolute value 
of the difference in position is nonlinearly compressed 
according to its size, or wherein a difference with a 
calculated value obtained by a movement mean has been 
nonlinear compressed can be used as functions used in 
the smoothing process. Switching the smoothing operation 
to strong when the designating device 4 is used as a 
pointer or to weak when it is not used a pointer may be 
effected by the control signal to optimise use conditions 
in both cases . 

The available time to finish the calculations is 10 
msec if the coordinate sampling frequency is 100 Hz as 
below, then the source data which has 64 pixels x 2 (for 
x and y coordinates, respectively) x AD conversion unit 
8 bits is very little. Further a low speed 8 bits 1 tip 
micro processor can process the data since convergence 
calculation is not necessary. This is effective for low 
cost, easy specification changing, short perio d 
development and easy development of derived products. 
Especially since the development of a special LSI for 
high speed image processing is unnecessary, the 
development cost and period is reduced. it has been 
described above to use an area sensor as an example. 
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The data signal showing the coordinate value (X, Y) 
obtained by calculating operation is sent from the 
coordinate calculation unit 32 to the communication 
control unit 33. The communication control unit 33 
inputs the data signal and the control signal from the 
control signal detection unit 72. The data signal and 
the control signal are converted to a communication 
signal having a predetermined form and transmitted to a 
display control device outside. Therefore the cursor, 
menu, character and line on the screen can be operated. 
As above, even if the sensor having 64 pixels is used, 
sufficient detection accuracy is achieved, and the sensor 
and optical system are low in size and cost, and the 
calculation circuitry is also very small in the 
coordinate input apparatus. 

The linear sensor 20 wherein a plurality of 
photoelectric conversion elements arranged on a line is 
described above, but another sensor comprising a two 
dimensional array of photoelectric conversion elements 
may be used for coordinate detection. In this case, 
condensor lenses for making a shaded off image are used 
instead of cylindrical lenses 90X and 90Y. Output 
signals of the photoelectric conversion elements are 
stored in memory, with the 2 dimensional position data of 
the respective photoelectric conversion element . The 



pixel having the maximum difference signal is found , and 
its position coordinates are obtained, based on the 
stored signals- The threshold value may be calculated 
based on the difference signals corresponding to pixels 
positioned on or within a circle which has a centre at 
the peak pixel, or on the basis of difference value from 
pixels in or on another closed curve surrounding the peak 
pixel or in a region surrounding the peak pixel. 

If an area sensor is used as a sensor, four times 
the number of pixels and calculation data is necessary 
for coordinate detection in two axial directions. 
However if linear sensors are used, only twice the number 
of sensor pixels provided for each axis is sufficient. 
In other words for a sensor having N pixels on each axis, 
linear sensors require the use of 2N pixels whereas an 
area sensor is required to have N 2 pixels. Therefore, 
more accurate detection is realized at lower cost by 
increasing the number of pixels in the linear arrays. 

As described above, the signal of the light spot 
flashing on and off in a predetermined cycle from the 
designation device 4 is integrated separately in each 
state, light emitting state and light non-emitting state, 
and obtain the difference signals for achieving an 
accurate determination of the position of the peak pixel 
in this embodiment. This enables an apparatus with high 



accuracy and high detection coordinate value reliability- 
can be obtained, the influence of ambient light is 
reduced and the apparatus is small, light and low cost. 

In the first embodiment, the difference data Dx(n) 
are compared to a fixed threshold THI corresponding to a 
voltage value V in the coordinate calculation operation 
shown in Figure 12. Therefore, if the PEAK value of Dx 
(n) does not exceed THI after the integration has been 
done nO times in the operation of Figure 11, namely if 
the luminous energy is not enough, the accuracy of 
coordinate detection is decreased- If nO is increased so 
as to achieve enough luminous energy, it results in 
decreased detection speed- This second embodiment takes 
measures to overcome this problem. 

As described in the first embodiment, the light from 
the light emitting element 41 arranged in the designation 
device 4 can be detected as a stable signal by the 
integral operation of sensor 20. But if the luminous 
energy reaching to the sensor 2 0 is decreased, the number 
of times the integration operation must be repeated to 
bring a peak level of the detection signal to a 
predetermined level is increased and the coordinate 
calculation sampling rate (the number of positions can be 
calculated every unit time) is decreased- At least a 
tens of points per second sampling rate, if possible one 



hundred points or more per second, is expected to 
recreate a user's writing accurately with the coordinate 
input device. If an LED is used as the light emitting 
element 41 in the arrangement of the embodiment of Figure 
2 , only few percent of the luminous energy emitted by the 
LED can reach sensor 20 in the worst case. This is 
confirmed by experimentation simulating real use or 
manufacturing conditions (various differences between 
individuals are expected). Although the luminous energy 
of and LED can be increased by increasing forward 
current, the electrical source (electric battery) 44 
arranged in the designation device 4 is consumed and the 
battery life becomes shortened. 

However a rechargeable battery or mains supply can 
be used as the electric source unit for solving the 
problem, it is inconvenient in use for a user because 
either the number of charge times is increased or the 
designating device has a trailing cord. There is thus a 
limit to the practicable increase in the luminous energy 
of the light emitting element 41. This second embodiment 
can alleviate the problem, and is described in detail 
below. 

In this embodiment, accurate coordinates can be 
detected even if the peak value of the signal output from 
the sensor doesn't reach TH1 when the predetermined 
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integral operation, for example the number of integral 
times nO and nl are set to achieve lOm/sec as a maximum 
integral time for one sample in order to achieve one 
hundred points per second as coordinate sampling rate, is 
completed. 

Figure 13 is a diagram showing an output level of 
each pixel in a sensor. Generally, the effective data is 
determined by using threshold level V. If the threshold 

Mr i 

^ level V is set to have a sufficient margin from noise 

in 

g 10 level in a condition the output signal is obtained 

i y 

enough, -then a stable coordinate can be calculated 
without the influence of noise. To set a lower threshold 
level is better since a decrease of detection signal 
level responding to a lack of luminous energy may occur 
depending to a real use condition as above. For example, 
a coordinate can be calculated with a smaller level of 
output signal if the threshold level is set to Vlow, but 
the calculation accuracy is decreased because the 
influence of noise becomes strong. 

Figure 16 is a flowchart showing a coordinate 
calculation processing according to this embodiment. The 
coordinate calculation excluding an influence of noise by 
decreasing the threshold level is explained in the 
processing in Figure 16. 



W 
14 



4'H 



15 



20 




• 



53 



3*5 5 ._ _ 

^ 10 

113 



After the process starts, a variable cont is set to 
0 for initializing in step S301, and a difference data 
Dx(n) (the number of pixels n=64 in this embodiment) 
which is a difference signal at each pixel of desired 
coordinate input point is read out in step S302. The 
values of Dx(n) are compared with the threshold value in 
step S3 11 and Ex(n) is stored for each pixel in a buffer - 
The operation in the steps S301, S302 and S3 11 is the 
same as the steps S201 - S203 described above with 
reference to Figure 12. 

Next a pixel where the output signal n peaJt is 
greatest is detected in step S303. The coordinate on the 
sensor XI is calculated according to the equation below 
by using the maximum output signal n pea )c and data of m 
adjacent pixels on either side of the pixel having output 
value n pealc in step S304. Therefore the number of pixels 
used is 2m+l . 

The coordinate calculation is effected using the formula: 




(1) 



set out in step S304 . 



Other steps S305 - S310 are the same as S205-S210 
described above and their description is omitted here for 
brevity • 

An efficiency of centroid calculation shown in step 
S304 is described with reference to Figure 15. Figure 15 
illustrates the accuracy of the calculation method of the 
prior art (left hand column) wherein a centroid is 
calculated using all the pixel difference signals, and 
the method of the second embodiment using various volumes 
of m pixels (i.e. differing numbers of pixels on either 
side of the peak pixel) to calculate the centroid. The 
actual coordinate position of the light spot and a 
detected coordinate at that point are compared and a 
difference , namely coordinate calculation accuracy, 
obtained for each point in an array of ten thousand 
points over the screen area. The calculation methods and 
conditions are shown along the horizontal axis and the 
calculated coordinate accuracy is shown on the vertical 
axis- Max means a maximum value of the calculated 
differences at the ten thousand points and the precision 
means a value Avg+3a obtained based on a mean value Avg 
and a standard deviation "a" of the distribution of the 
obtained differences in Figure 15. 

If the threshold voltage is set 0.75V and the 
coordinate is calculated according to the operation shown 
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in Figure 12, then not only is Max of the accuracy 
decreased badly but also there are some areas where 
coordinates can not be calculated caused by a lack of 
luminous energy in the figure. The accuracy of 
coordinate calculation comes to be high at higher 
threshold levels but the uncalculatable coordinate area 
expands. If the value m is set at about 4, then by using 
the calculation method shown in Figure 16, the coordinate 
calculation can be done in all areas and a good enough 
calculation result can be obtained. 

Higher efficiency in the coordinate calculation 
operation even if the signal level output from the sensor 
is small and a highly accurate coordinate input device 
can be obtained, with a higher sampling rate of 
coordinates by the reduction of the integral period than 
the calculation operation shown in Figure 12. The life 
of the battery 4 4 in the designation device 4 may be 
extended by making LED light emitting weaker. 

(The Third Embodiment) 

Figure 17 is a flowchart showing a coordinate 
calculation processing according to the third embodiment. 
After the processing has started in Figure 17, a variable 
cont is set to 0 for initializing in step S401, and 



difference data Dx(n) corresponding to a difference 
signal at each coordinate input device is read out and 
stored in the buffer in step S402. Next a pixel n peak 
where output signal becomes maximum is detected in step 
S403, and m-th pixels in each direction forward and 
backward from the pixel n peak are selected and the signal 
levels of both selected pixels Dx(n peak -m) and Dx(n peak +m) 
are compared in step S411. The smaller of the signal 
levels is set as a threshold value based on the 
comparison, and the output signals of each of the pixels 
are compared with the threshold value in step S413 or 
step S414. The smaller one is set as the threshold value 
in this embodiment, and Figure 14(A) shows a case where 
m=3. In the figure, it is clear that the threshold value 
is set Dx (n peak -m) . 

Next the effective pixels for the centroid 
calculation is determined in step S415- Now the 
effective pixels determination is explained. If data 
Ex(n) for pixel n derived by the operation above is 
positive, it is clear that the signal is over the 
threshold level is output at pixel n. But since the set 
threshold level is a changeable threshold value changed 
with the signal outputs from pixels on either side of the 
peak value, the set level can be a noise level in the 
weak luminous energy condition. If a noise signal is 
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outputted at a pixel far enough from the pixel n peak , it 
is calculated as a moment (a term of nEx(n) ) even if the 
signal component is small. Therefore the error is not a 
little effective. Then in this embodiment if Ex(n) is 
5 positive for a pixel n, only output signals from pixels 

in a series having consecutive pixel numbers and 
ffl including the maximum pixel n peak are determined as 

j| effective pixels and the minimum value n min and the 

| maximum value n Bax of the pixel numbers ( n^,<i W <n MX ) of 

pixels being used in the calculation are selected in step 
S415. The selected effective data are shown in Figure 
14(B). The threshold value is changeable and the number 
of pixels used in this calculation is changeable, 
however, both are fixed in the operation of Figure 16. 
Next the centroid position XI is calculated based on the 
equation below by using only the effective pixels 
selected in step S415, namely the pixels whose numbers 
lie between n ffiln and n^ in step S404. 
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XI = 2^ nEx(n) / £ Ex(n) 



(2) 

The operation in steps S405 - S410 are the same as 
the steps S205 - S210 above and their description is 
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omitted here. Now, an effect obtained by the centroid 
calculation is described. 

Figure 18 and Figure 19 show output results examples 
of coordinate calculation precision in a part of 
coordinate input apparatus (40x40mm) having a 1200x900mm 
coordinate input effective area size. X axis and Y axis 
corresponding to the position designated by the input pen 
4, Z axis shows a difference between Y coordinate value 
outputted by the coordinate input apparatus and the Y 
coordinate value corresponding to the real input position 
in the figure. Therefore, where the difference is being 
about 0, the accuracy of the coordinate input apparatus 
is very high. Figure 18 shows the result of the 
coordinate calculations made in accordance with the 
operation shown in the flowchart of Figure 16. Likewise, 
Figure 19 shows the result of the coordinate calculation 
accordance with the flowchart in Figure 17. However the 
measurement error of the calculation method of Figure 16 
is approximately 10mm, while the error of the calculation 
method of Figure 17 is better, decreased to about 2- 
2.5mm. Also the step effect shown in Figure 15 has not 
been generated and the distribution of error is smooth. 
It means that the calculation method of Figure 17 brings 
better detection in the coordinate input apparatus than 
the calculation method of Figure 16 and it's clear that 



the coordinate input apparatus can obtain a high accuracy 
and a high detection. 

The smaller one of m-th pixels spaced in each 
direction backward and forward from the pixel n peak having 
the maximum difference data is selected as a threshold 
value used for the effective pixel extraction in step 
S415 in the above embodiment. Alternatively, the value 
of the threshold may be set to be the bigger of Dx(n pea)c 
+ m) and Dx(n pea]t -m) in the above threshold value setting 
stage, and then a higher signal level is selected as the 
threshold level. In a further alternative, the threshold 
value can be determined by for example calculating the 
means of the 2m+l values of difference data corresponding 
to the pixel n peajc having the maximum difference data and 
next m pixels in each direction backward and forward from 
that pixel, and setting the threshold to this mean value 
or to a multiple or submultiple thereof. 

In the above embodiment, the difference signal is 
calculated by using the integral calculation of signal, 
which is a flashing light having a predetermined cycle 
from the designation device 4, separately in light 
emission state and in light non-emission state, and the 
pixel having the maximum difference signal (the pixel 
number n peak ) is detected, the threshold value for 
deciding the effectiveness of each pixel is set by using 



the m-th pixels in each direction backward and forward 
from the detected pixel n peak or 2m+l pixels corresponding 
to m pixels in each direction backward and forward of the 
detected pixel. The effective pixels are selected by 
using the set threshold value and the coordinate is 
calculated by using the output data of the selected 
pixels- Therefore a coordinate input apparatus having 
high accuracy and high detection reliability can be 
obtained. 

(The Fourth Embodiment) 

In this embodiment, a determination is made as to 
whether or not the set threshold value is effective for 
identifying the receiving light which is the light 
emitted from the light source arranged in the designating 
device. The determination provides higher accuracy and 
reliability in coordinate detection. If the products 
using the sensor are manufactured in quantity, the 
differences between products and their parts should be 
considered. Especially, the output voltage when no light 
reaches the sensor, namely output voltage in dark 
condition, is a problem. The output voltage in dark 
condition usually varies by plus and minus dozens of % 
from the nominal value, due to manufacturing tolerances. 
The distribution is from about 0.7 V to about 1.3 V 



depending on -the difference between each product if the 
electric source voltage is 5 V and it is assumed that the 
nominal output voltage in dark condition is 1 v. 
Therefore, the threshold level must be set at 1.3 V or 
higher, but in this case, a situation that a product 
having a output voltage in dark condition of 0.7 V is 
operated at a threshold voltage of 1.3 V may be occur. 
Namely the coordinate can not be calculated when the 
luminous energy is weak and only the peak level reaches 
1.3 V. Contrary to that, the confidence of coordinate 
calculation is low and a higher threshold value must be 
set since the threshold value set at 1.3 V provides no 
margin against the noise for components in the product 
having an output level in dark condition of 1.3 V. 
Therefore, if the product tolerance is considered, the 
setting of the threshold level depending on parts 
tolerances is necessary, and the need for adjustment of 
every product increases costs. For removing the 
influence, in Figure 20, the operation starts in step 
S501 and difference data Dx(n) (the number of pixels n=64 
in this embodiment) which is a difference signal at each 
pixel of desired coordinate input point is read out in 
step S502. The mean of the output signals from all of 
the pixels (64 pixels) is calculated and the mean value 
is added to a predetermined offset amount Voff to define 



a first threshold value Vthl (step S 503). The first 
threshold value is used for determining the effectiveness 
of output signals (See Figure 13(B)). Namely, Vthl can 
be changed in dependance on the luminous energy input to 
the sensor namely the signal level and on the output 
voltage in dark condition, then the product's tolerance 
of each sensor is considered and the best threshold level 
is set automatically. 

Next a pixel n peak having a maximum value of the 
difference data Dx(n) is detected in step S504, and 
D x(n peaJc -m) and Dx(n peaJt +m) which are output values of the 
m-th pixels in each direction forward and backward from 
the pixel n^^ are obtained and these values are compared 
in step S505. Next a second threshold value Vth2 is set 
based on the comparison result in each of steps S506 and 
S507. The smaller value of Dx(n peaJc +m) and Dx(n peajc -m) is 
set as the second threshold value Vth2 in this 
embodiment, and in the case of m=3 shown in Figure 
13(C) then the threshold value Vth2 is set at Dx 
(n P eak-ni). Although the smaller signal level is set as 
the threshold level in this embodiment, the larger value 
may be set as Vth2 so that a higher signal level is set 
as the threshold level. . - - - 

Next the first threshold level Vthl and the second 
threshold level Vth2 are compared in step S508. If the 



second threshold level Vth2 is bigger than the first 
threshold level Vthl then it can be concluded that 
sufficient light is incident on the sensors for a 
coordinate calculation to proceed, and the coordinate 
calculation is executed. However if Vth2 is smaller than 
Vthl, the necessary amount of light to detect coordinate 
values is not present, and the operation stops and the 
flow returns to step S501. 

The Dx(n) of each pixel is compared with the second 
threshold value Vth2 in step S509 and Ex(n) is stored in 
a buffer. Next only the series of consecutive pixels 
exceeding threshold Vth2 and including the peak pixel 
number n peak are selected in step S510 and the coordinate 
on the sensor XI is calculated. Where operations 
correspond to steps in earlier methods corresponding 
numbering is used and the description is omitted. 

The effective pixels determined in step S510 of this 
embodiment are shown in Figure 21C. Since the second 
threshold value Vth2 has been set at Dx(n pea]l -m) (the 
value of the n peak -m pixel ) , the output value of not only 
n P aak+m pixel but also n pealc +m+l pixel in the case of the 
Figure is used for the coordinate calculation as an 
effective pixel. The first and second threshold values 
are changeable and the number of pixels used in 
calculation is changeable, however, both are fixed in the 



operation of Figure 16. 

Figure 22 shows the coordinate calculation precision 
of a part (4 0x4 Omm) in a coordinate input apparatus 
having a 1200x900mm coordinate input effective area size 
in the case of this embodiment. In this Figure, the 
distribution of error is smooth, then the calculation of 
Figure 20 is better detection in the coordinate input 
apparatus is shown, and the coordinate input apparatus 
can obtain a high accuracy and a high detection by the 
calculation. The coordinate input method and devices of 
the invention can be embodied in one or more parts of a 
system constituted by a plurality of devices (for example 
host computer, interface device, reader, printer and so 
on) and in a single device (for example copy machine, 
facsimile machine and so on) . 



